Matrices, transposes, and inverses 

Math 40, Introduction to Linear Algebra 
Wednesday, February 1, 2012 


Matrix-vector multiplication: two views 

• 1st perspective: Ax is linear combination of columns of A 
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2nd perspective: Ax is computed as dot product of rows of A with vector x 
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Notice that # of columns of A = A of rows of x ■ 

This is a requirement in order for matrix multiplication to be defined. 





































Matrix multiplication 


What sizes of matrices can be multiplied together? 


For m x n matrix A and n x p matrix F>, 


m x n n x p 


parameters 
must match 


the matrix product AB 
is an m x p matrix. 


“outer” parameters become 
parameters of matrix AB 


If A is a square matrix and & is a positive integer, we define 

A k = A • A • • • A 

k factors 


Properties of matrix multiplication 


Most of the properties that we expect to hold for matrix multiplication do.... 

A(B + C) = AB + AC 
(AB)C = A(BC) 

k(AB) = ( kA)B = A(kB) for scalar k 
.... except commutativity!! 


c > 

In general, AB ^ BA. 













Matrix multiplication not commutative 


Problems with hoping AB and BA are equal: 

* BA may not be well-defined. 

(e.g., A is 2 x 3 matrix, B is 3 x 5 matrix) 

• Even if AB and BA are both defined, AB and BA may not be 
the same size. 

(e.g., A is 2 x 3 matrix, B is 3 x 2 matrix) 


/-\ 

In general, 

AB ± BA. 

\ _i_ 


• Even if AB and BA are both defined and of the same size, they 
still may not be equal. 
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Truth or fiction? 


Question 1 For n x n matrices A and B, is 

A 2 - B 2 = {A - B)(A + B) ? 


No!! I {A - B)(A + B) = A 2 + AB - BA - B‘ 

7^0 


Question 2 For n x n matrices A and B, is (AB) 2 = A 2 B 2 7 



(AB) 2 = ABAB ± AABB = A 2 B 2 



























Matrix transpose 


Definition The transpose of an to x n matrix A is the n x to matrix 
A T obtained by interchanging rows and columns of A, 


i.e., (A T )ij = Aji ViJ. 


Example 


A = 


\ 3 5 

5 ''*'3 2 

* 

% 



Transpose operation can be viewed as 
flipping entries about the diagonal. 



Definition A square matrix A is symmetric if A T — A. 


Properties of transpose 


(1) (A t ) t = A 


apply twice — get back 



to where you started 


(2) (A + B) t =A t + B t 

(3) For a scalar c, ( cA) T = cA T 


(4) (AB) T =B t A t 


Exercise 

Prove that for any matrix A, A T A is symmetric 


To prove this, we show that 
UB) T ] l3 = 


= [(■B 1 A* )] tj 











Special matrices 


Definition A matrix with all zero entries is called 
a zero matrix and is denoted 0. 


0 0 0 0 
0 0 0 0 
0 0 0 0 


Definition A square matrix is upper-triangular 
if all entries below main diagonal are zero. 

analogous definition for a lower-triangular matrix 


A = 


; 2 . - 
'> 4 

0 'fi- 
0 0 



Definition A square matrix whose off-diagonal 
entries are all zero is called a diagonal matrix. 


-§ 0 0 O' 

0-200 
0 0-4 0 

0 0 0 1 


Definition The identity matrix , denoted is the 
n x n diagonal matrix with all ones on the diagonal. 


1 0 0 
0 1 0 
0 0 1 


Identity matrix 


Definition The identity matrix , denoted In, is the 
n x n diagonal matrix with all ones on the diagonal. 


1 0 0 
0 1 0 
0 0 1 


If A is an m x n matrix, then 
ImA — A and AI n — A. 



Important property 
of identity matrix 



If A is a square matrix, then 
IA = A = AI. 





































































Matrix inverses 


Definition A square matrix A is invertible (or nonsingular) if 3 matrix 
B such that AB = I and BA = I. (We say B is an inverse of A.) 


Example 


A = 


2 7 
1 4 


is invertible because for B = 


4 


we have AB = 
and likewise BA = 


'2 7 
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The notion of an inverse matrix only applies to square matrices. 

- For rectangular matrices of full rank, there are one-sided inverses. 

- For matrices in general, there are pseudoinverses, which are a generalization to matrix inverses. 


Example Find the inverse of A 
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. We have 


i r 


a b 


'1 O' 

_x 

a + c b T d 


'1 O' 

i i 


c d 


0 1 

- r' 

a T c b T d 


0 1 


> a + c = 1 and a + c = 0 Impossible! 


Therefore, A 


1 1 
1 1 


is not invertible (or singular). 


Take-home message: 


Not all square matrices are invertible. 
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Important questions: 

• When does a square matrix have an inverse? 

• If it does have an inverse, how do we compute it? 

• Can a matrix have more than one inverse? 


Theorem. If A is invertible, then its inverse is unique. 

Proof. Assume A is invertible. Suppose, by way of contradiction, that the 
inverse of A is not unique, i.e., let B and C be two distinct inverses of A. 
Then, by def’n of inverse, we have 

BA = I = AB (1) 
and CA = I = AC. (2) 

It follows that 


BI 

by def’n of identity matrix 

B(AC) 

by (2) above 

(BA)C 

by associativity of matrix mult 

IC 

by (1) above 

c. 

by def’n of identity matrix 


Thus, B = C , which contradicts the previous assumption that B ^ C. 
=^<^= So it must be that case that the inverse of A is unique. ■ 


Take-home message: 


The inverse of a matrix A is unique, 
and we denote it A -1 . 


Theorem (Properties of matrix inverse). 

(a) If A is invertible, then A -1 is itself invertible and (A -1 ) -1 = A. 


Lecture 7 


Math 40, Spring ’12, Prof. Kindred 


Page 2 




(b) If A is invertible and c 0 is a scalar, then cA is invertible and 
(cA)- 1 = \A~'. 

(c) If A and B are both nx n invertible matrices, then AB is invertible 
and {AB)- 1 = B~ l A~ l . 

u socks and shoes rule ” - similar to transpose of AB 
generalization to product of n matrices 

(d) If A is invertible, then A T is invertible and {A T )- X = (A -1 ) 7 ? 

To prove (d), we need to show that there is some matrix_such that 

A t = I and A t = I. 


Proof of (d). Assume A is invertible. Then A 1 exists and we have 

{A- 1 ) t A t = {AA- l ) T = I t = I 

and 

A t {A~ 1 ) t = (A“ 1 A) r = I T = I. 

So A T is invertible and (A T ) _1 = (A _1 ) T . ■ 


Question: If A and B are invertible n x n matrices, 

what can we say about A + B1 

There is no guarantee A + B is invertible even if A and B themselves are 
invertible! In other words, we CANNOT say that {A + B)~ l = A -1 + B~ l . 

How do we compute the inverse of a matrix, if it exists? 
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Inverse of a 2 x 2 matrix: Consider the special case where A is a 2 x 2 
matrix with A = [ a c h d \. If ad — be 0, then A is invertible and its inverse is 


A~' = 


1 


ad — be 


d -b 
-c a 


★ Exercise: Check that AA 1 = [J }] = A 1 A. 


Example For A = 


-2 1 
3 -3 


, we have 
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We can easily check that 

AA _1 = 

and 

A- 1 A = 


'-2 1 " 


r-i -ii 
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How do we End inverses of matrices that are larger than 2x2 matrices? 


Theorem. If some EROs reduce a square matrix A to the identity matrix 
I, then the same EROs transform I to A -1 . 


A 

I 

EROs 

I 

A 1 








If we can transform A into /, then we will obtain A 1 . If we cannot do so, 
then A is not invertible. 
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Example: Find the inverse of the matrix A 


'-1-31' 

3 6 0 . 

L 1 o lj 


[-1-3 1 

1 0 0] 


[-1-3 1 

1 0 0] 

3 6 0 

0 1 0 

R2+3RI 
- > 
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0 0 1_ 
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0 -3 2 

1 0 1 _ 


-Ri 

R 3 -R 2 


' 1 

3 

-1 

-1 

0 

1 

0 

0 

-3 

3 

3 

1 

0 

1— 

0 

0 

-1 

-2 

-1 

1 _ 


R 1 +R 2 

-r 3 


' 1 

0 

2 

2 

1 

1 

0 

0 

-3 

3 

3 

1 

0 

1 - 

0 

0 

1 

2 

1 

-1 _ 


-\r 2 

- > 


R\-2R 3 
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0 2 

2 10" 

1 -1 

-1 0 

0 1 

2 1 -1 

1 0 0 

-2-1 2 

0 1 0 

1 - -1 

3 

0 0 1 

2 1 -1 _ 


Thus, A is invertible and its inverse is 





Why does this work? =^> discussion next class 
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